On the existence of maximizing measures for irreducible 
countable Markov shifts: a dynamical proof 



Rodrigo Bissacot 

Department of Applied Mathematics, IME-USP, Brazil 
rodrigo . bissacotOgmail . com 

Ricardo dos Santos Freire Jr. 

Department of Mathematics, IME-USP, Brazil 
rf reireOusp . br 



We prove that if E a (N) is an irreducible Markov shift space over N and 
/ : Sa(N) ^ R is coercive with bounded variation then there exists a maxi- 
mizing probability measure for /, whose support lies on a Markov subshift 
over a finite alphabet. Furthermore, the support of any maximizing measure 
is contained in this same compact subshift. To the best of our knowledge, this 
is the first proof beyond the finitely primitive case on the general irreducible 
non-compact setting. It's also noteworthy that our technique works for the 
full shift over positive real sequences. 
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1 Introduction 

Given a dynamical system T : — )• 17 over a space and a real function /, the main 
problem in Ergodic Optimization is to guarantee the existence and characterize 
the support of the maximizing measures for the system, that is, the invariant 
Borel probability measures maximizing the operator J fd/i over the invariant Borel 
probabilities for T. The survey [5] is a good introduction to these problems. 

If the is compact, the existence of the maximizing measures is an immediate 
consequence of the compactness in the weak*-topology of the set of invariant pro- 
bability measures. On the other hand, in the non-compact case even the existence 
is a non-trivial problem. See, for instance, [21 [6l [3 [8] . 

We focus in the case vi^here the space is a irreducible Markov shift over N and 
the dynamics is given by the shift map, that is, 17 = Sa(N) and T = a. Given / 
we define 
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and our main result is the following: 

Theorem 1. Let a be the shift on Sa(N) with A irreducible, f : Sa(N) — > M 6e 
a function with bounded variation and coercive. Then, there is a finite set ^ C N 
such that A|_4x^ is irreducible and 

/3 = sup f dfi . 

Furthermore, if v is a maximizing measure, then 

supp V C Mai^K^J^) ■ 

Since Sa(^) is compact, it follows from the first part of the theorem that 
there is at least one maximizing measure supported on a subset of Ea(^)- 

Similar results for finitely primitiv^ subshifts can be found in [21 [6l [TJ [HI [9] . 
In fact, to the best of our knowledge, our result is the first beyond the finitely 
primitive case, except for the particular case of renewal shifts in [3]. 

When / is not coercive, the best known results are [21 [7] that still requires 
finitely primitive, which follows from the classical oscillation condition. In this 
case, but in the irreducible context, we're able to prove the following similar result 
to the ones in [21 [7] : 

Theorem 2. Let a be the shift on Sa(N) with A irreducible, f : I;a(N) ^ R 6e 
a function with bounded variation and assume there are naturals I2 > /i > such 
that 

sup/|[j] < P -e Vj > Ii , 

for some e > fixed and 

sup / 1 [j] < min{ Ci , C2 } Vj > I2 , 

where Ci and C2 are constants (depending on Ii) given in 

Then, there is a finite set ^ C N such that A|^x^ is irreducible and 

/3 = sup f dfi . 

Furthermore, if v is a maximizing measure, then 

supp V C a^^(i;a(^)) • 

Our technique also points out a more natural and elementary approach to the 
problem of the existence of maximizing measures on the non-compact context. 
The proofs available up to now pass through the construction of auxiliar func- 
tions (normal forms [7j and subactions [2]) that characterize the support of the 

^The subshift is finitely primitive ifi' there is Kq £ N and a finite sub-alphabet £ such that 
any pair of symbols in the alphabet can be connected by a word of exactly Ko of symbols in £. 
It's clearly much more stronger than primitive, when you don't require £ to be finite, which is 
stronger than irreducible, where there's no uniformity in word length connecting two symbols. 
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maximizing measm'es or, make use of the thermodynamic formahsm [6l|9], where 
more restrictions on the dynamics and the potential / are made. We just use a 
well-known Parthasarathy's result [H] that says the invariant measures supported 
in periodic orbits are dense in the ergodic invariant measures for a. 

In this way, we reduce our problem into analyzing the ergodic averages of 
periodic orbits, and the proof is essentially to carry on in details the intuitive 
idea: since the potencial / decays to — oo when the symbols grow, we can restrict 
ourselves to periodic orbits whose symbols are all small. 

An important consequence in these contexts is the subordination principle, 
that is a direct application of the results in [3] or [10] after the reduction to the 
compact case by our results. 

Finally, we remark that our technique can be used in more general contexts, 
such as the case of the full shift on $](M'*"). 

The paper is organized as follows: in the next section we give the precise 
setting and notations to prove the existence part of the theorems in section 3. In 
section 4, we finish the proof of the theorems showing that the support of any 
maximizing measure must be in the subshift over the finite alphabet built in the 
previous section. Finally, in section 5 we point out how our technique works in 
the case of sequences of positive reals. 

2 Setting and notations 

Let N be the set of non- negative integers and $](N) be the set of sequences of 
elements in N. Given an infinite matrix A : N x N ^ {0, 1}, we call by Sa(N) the 
subset of S(N) of allowable sequences, that is: 

Sa(N) := {x e S(N), A{xi, Xi+i) = 1 Vi > 0} . 

Fixed A G (0, 1), we define a metric on $]a(N) by d{x,y) = X^, where k is the 
first coordinate where x^ Uk- 

Denote by vr : Sa(N) — )■ N the projection of the first coordinate, that is 

'k{x) = Ti{xqXiX2 ...) = Xq. 

We say that A is irreducible when for any i, j in N there exists a word w = 
wi...Wk such that iwj is an allowable word: A{i,wi) = 1, A(t(;j, Wj+i) = 1 for 
i = 1, . . . ,k — 1 and A{wk,j) = 1. 

Our dynamics is given by shift map a : Sa(N) — > Sa(N) where {a{x))i = Xj+i 
for all i > and we denote by 7V4(j(Sa(N)) the set of invariant Borel probability 
measures for this map. It's clear that a is surjective as A is irreducible. 

Fix a function / : Sa(N) — )• M and consider the j-th variation of / given by 

Vjif) := sup{/(x) - f{y) , 7T{a'{x)) = 7r{a\y)) for i = 0, . . . ,i - 1} , 
and suppose that / has bounded variation, that is 

oo 
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Also, we suppose that / is coercive in the sense that 

hm sup/|m = -oo, 

where [i] := {x G Sa(N), tt{x) = i} is the cyHnder beginning with i. 

Since / is coercive and has bounded variation, it's easy to see that / is con- 
tinuous and bounded above, which imphes that /3 as defined in the introduction 
is, in fact, weh defined. 

Our existence problem is to show there is a finite alphabet ^ C N and a maxi- 
mizing measure for /, that is, an invariant probability measure u G A^o-(5^a(N)) 
such that 




where u is supported on Sa(^), the set of allowable sequences of symbols in A. 



3 Proof of the existence results 

Let A4a-Per(^) be the set of periodic invariant probability measures, that is, the 
invariant probability measures that are supported on a periodic orbit of a. This 
set is extremely important since we can reduce the problem into the study of 
periodic orbits through the following lemma. 

Lemma 1. 



/3 = sup f dfj,. 

AieA^<,-Per(SA(N)) J 

Proof. The Ergodic Decomposition theorem implies that 



/3 = sup / / d/i , 

where Aia-ergC^Ai^)) is the set of ergodic invariant probability measures. 

By [H] the periodic invariant probability measures are dense in ^Aa-erg{'^Ai^)) 
and we're done. □ 

We denote the set of n-periodic points of a by Per„(cj) and the set of all 
cj-periodic orbits is Per((T) := IJn>i P6r„((T). 

m— 1 

Definition 1. Let Smf{x) := ^ fi(T\x)), we use the following notation: 

i) for any x G Sa(N) let I3m{x) := —Smf{x); 

m 

ii) for any x G Sa(N) denote by := lim /3m{x) whenever the limit exists. 
Notice that if x ^ Per„((T) then the ergodic average of x is f3{x) = 

Hi) we say that x G Sa(N) starts in i when i is the smallest natural that appear 
in the coordinates of x. In particular, if x & Pern{a) we have 

^ = min {7r(CT-'(x))}; 

0<j<ra--l 
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iv) given a pair i,j in N we say that a word w = wi . . . Wk connects i to j when 
iwj is an allowable word: A(i, wi) = 1, A{wi, Wi^i) = 1 for i = 1, . . . ,k — 1 
and A{wk,j) = 1. 

Since J f dfi = ^J27=o fi^^i^)) when ^ is a periodic invariant probability 
supported on the orbit of x € Per„((T), it's clear from lemma [1] that 

/3 = sup . 

x£Per((T) 

Then, our problem is reduced into showing the existence of a finite alphabet ^ C N 
such that 

/3= sup /3{x). (1) 

xGPer(o-)nSA(^) 

Now we make a first cut on the symbols. The following lemma, together with 
lemma [H implies that we don't have to care about periodic orbits whose symbols 
are all too large. 

Lemma 2. Given e > 0, there is /i G N such that if x starts in i > Ii then 
f3m{x) < /3 — e for any m € N. In particular, if x € Pern{cr) we have f3{x) < /3 — e. 

Proof Since / is coercive, there is /i G N such that 

sup < P -e for all j > h . 

We have that 

^ ^ m—1 ^ m—1 

I3m{x) = —Smf{x) = — V f{(T^{x)) < — Y] SUp / 1 [^(^, (^))] , 

i=o j=o 
and since 7r(cj-'(a;)) ~>i>l\ for all j = 0, . . . , m — 1, we get 

^ m—1 

/3m (x) < — X] sup/|[^(^.(^.))] < /5 - e- 

□ 

Let's fix e > 0. If we consider the alphabet T\ := {0, 1, . . . , /i — 1} we still have a 
problem that maybe there are no allowable sequences only with such symbols and, 
besides, the shift does not need to be irreducible when restrict to such sequences. 
So we complete Ii to a finite alphabet Ai in the following manner. 

We choose, for each pair i,j in Ii, one word w = w{i,j) connecting i to j. 
Notice there is such a word since A is irreducible. We denote by Pq the length of 
the longest of such connecting words. Let Ci the set of symbols that appear in all 
of these connecting words and then consider Ai := Xi UCi. Since each connecting 
word has at most a finite number of symbols, and we have chosen words, we 
have that Ai is finite. 

It's clear that any pair of symbols in Ai can be connected using only symbols 
in Ai- This means that A restricted to Ai is irreducible. 
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Therefore Sa(^i) := {2; G Sa(N), 7r((T*(x)) G Ai > 0} is a compact 
invariant subspace of Sa(N). 

Now we can make a second cut on the alphabet and show it's enough. In fact, 
since / is coercive, there is I2 > h such that 

sup/ly] <min{Ci,C2} Vj > /a , (2) 

where 

Ci = - (PoImin/|s^(^^)| + (Po - + ^Vif)) , 
C2=P-e-Vif). 

Then we can complete I2 = {0, 1, . . . ,I2 — 1} into a finite alphabet A2 in the 
same way we did with Ai, with the same dynamical properties. It's also clear that 
we can take A2 such that Ai C A2- 

We need some control over the ergodic average on parts of a given orbit. For 
that purpose, the following definition is convenient: 

Definition 2. Let x € I1a(N) and w = X£ . . . x^^^n be a word appearing on x. 
Then: 

1. the ergodic average of the word w = x^. . . x^+m on the orbit x is 

^ m 

K{e,m\x) = k{w\x) := — r /(^^^^(^)) ! 

j=0 

2. if r < m we define 

Kr{e,m\x) = Kr{w\x) := ^ j ) + ^ (x)) 

The following facts shows the relation between the previous definition and the 
ergodic average of a periodic orbit. 

Fact 1. Let x € Sa(N) be a periodic orbit for a such that /3(x) > /3 — e and 
X ^ Sa(^2)- Then, there is at least one word X£ . . . x^+m appearing in x such that 

1. K{i, m\x) > /3(x); 

2. xg < Li, xg+rn > h; and 

3. Xi^j < L2 for all j G {0, . . . ,m — 1}. 

Proof. Since /3(x) > /? — e, lemma [1] implies that x starts in i < Li. 

And because x ^ Tia{A2), we have that there is at least one symbol greater or 
equal to L2 appearing on x, as by construction we have that I2 C A2- 
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This shows that there is at least one word appearing in x satisfying both 
properties 2 and 3. For each such word, we may take it to be the longest one 
satisfying such properties, and in this sense let's call it a maximal word. 

Since x is periodic, there is at most a finite number of such maximal words 
appearing in x. Also, if a symbol on x is not on any of these maximal words, it 
must be greater or equal to /i, otherwise it would be possible to extend a maximal 
word, which is absurd. 

We can write a period of concatenation of maximal and non maxi- 

mal words, that is, wq . . .Wk represents a period of x and each word wj for j G 
{0, . . . ,k} is either maximal or has only symbols greater or equal to Ii. Let Ij be 
the length of the word Wj and we get 



/3(x) = — ^^£jK{wj\x) . 
^ j=o 

Let i he a word such that k{'wi\x) = ma,Xj^^Q j^y{K{wj\x)}. Then 

k 



j3{x) < — ''^^^ljK{wi\x) = K,{wi\x) 



n 

3=0 

As in lemma[2l if is not one of the maximal words, then n^w^lx) < (3 — e. Since 
/3{x) > /3 — e, wi must be one of the maximal words and our claim follows taking 
Xe... Xi+rn ■= Wi- □ 

Fact 2. Let X£ . . . Xi^m be the word given by fact 1 and r < m be the greatest 
integer such that Xi^r ^ • Then 

k{£, m\x) < Kr{i, m\x) . 

Proof. In fact, we have by definition that 

1 / """^ 

K(e,m\x) = I (r + 2)Kr(i,m\x)+ V f(a^+^(x)) 

m + 1 I ^-^ 

\ j=r+l 

and since ■K{a^~^^ {x)) > Ii for j > r + 1, from the same argument of lemma [2] it 
follows that 

k(1, mix) < ((r + 2)Kr(i, mix) + (m — r — — e)) , 

m + 1 

and recall from fact [1] that K{i,m\x) > /3(x) > /3 — e and so 

V ~\~ 2 TTl — T — 1 

n(i,m\x) < Kr(£,m\x) H K(i,m\x) . 

m + 1 m + 1 

Now, reordering the last expression 

r + 2 r + 2 

K(i,m\x) < Kr(i,m\x) , 

m + 1 m + 1 

and the result follows. □ 
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Let 6 := min{Ci,C2} — sup/|u^^^_^[j] > 0, where the constants are from ([2]). 
The following lemma is the key to complete the proof of theorem [TJ 

Lemma 3. Let x S Sa(N) be any periodic orbit for a such that x ^ T,a{A2) and 
(i{x) > /3 — e. Then, there is a periodic orbit z E Sa(^2) such that (3{z) > (3{x). 

Proof. Consider x^ . . . x^+m the word given by fact [H and r < m the greatest 
integer such that xi+r £ • 

Now, take z = {xi . . . xg+rw), that is, the orbit made by repetition of the word 
xg. . . Xi^rW, where w is the word of size q connecting x^+r to X£ made of symbols 
in Ai , chosen in the definition of Ai . 

Notice that both x^ and x^+r are in Zi by facts [T] and El but x^+^+i ™ay not 
be in ^i, and it's important for our estimates bellow that we use only connecting 
symbols in ^i. 

By facts [1] and [21 we know that Kr{i,m\x) > K{i,m\x) > /3(x). So, we're left 
to show that /3{z) — 5i > Kr{£,m\x) for some 6i > 0. 
In fact, we have 



3=0 



and since / has bounded variation and x^+j = Zj for all j G {0, . . . ,r}, we have 
that 

r r 

Y.f{a'^^{x))<Y^f{a^{z)) + V{f), 

j=0 j=0 

so we get 



K.(Am|x)<^ |^/(a^+™(x)) + ^/(a^(z)) + y(/)j . (3) 
Recall that 7r{a^^"^{x)) > I2 and from ([2]) and the definition of 6 we have that 



/(cT^+™(x)) < sup/|u^,^,^[,] = min{Ci,C2} - 5 < - 5 , (4) 

for i = 1,2. 

We have 2 cases to consider: g > 1 and q = 0. 

First, assume that q > I and recall from and Ci in ^ that 

/(cT^+-(x)) < -Pol min/|s^(^^)[ - 2V{f) + (1 - PoM - 5 . 
Notice that 

j=l j=0 

> gmin/|2A(_4^) - 

> -Po|min/|2^(^^)|-y(/), 
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where ^aux is any point in T,a{Ai) starting by the word w. For example, we can 
take Zaux a periodic point, connecting Wq to wi just hke we did to obtain z. 
In this way, we get in the previous inequahty 



fia'+'-^ix)) < f{a'^'{z)) - V{f) + (1 - Po 
Applying this to ([3]) we have 



\i=o j=i 



KrU.,m\x) < 

r + 

= fi{z) + y^{{q-i)m + {'^-pm-^) , 

and since /3(z) < /3 < |/3|, we have that 

{q-l)P{z)<{q-im<{Po-im, 
implying that {q - l)P{z) + (1 - Po)|/3| < 0. Therefore 

Kr{l,m\x) < P{z) — := I3{z) - di , 

r + 2 

as we wanted. 

Finally, assume that q = 0. That means z = (x^TTTxJ^). 
From (jl]) and C2 in ([2]) we have that 



/(a^+™(x))</3-6-y(/)-(5, 



and from ([3]) we get 

Kr{i,m\x) < 



< 



r + 
1 



((r + l)/3(z)+/3-6-5) 



r +2 r +2 ' 

and since by facts [1] and [2] we have Kr{i,m\x) > /3 — e, the last inequality also 
implies that 
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from which we have that /? — e — /3{z) < 0, and so 

Kr{£,m\x) < I3{z) — = /3{z) - 6i , 

r + 2 

as desired. □ 

Remark 1. It's important to reahze that in lemmaE] we've proved that exchanging 
X£+m > h for w, we have increased at least (5 > in the ergodic sums. That is, 
Sm+if{c^^(x)) + 6 < Spf{z), where p is the period of z. This will be important in 
the next section. 

Now we're able to complete the proofs of the existence of a maximizing mea- 
sure. 

Proof of the existence in Theorem [Jl Recall that our problem is reduced into prov- 
ing ([T]), and that lemma [T] implies that 

/3 = sup f3{x) . 

Let € Per((T) for all n be a sequence of periodic orbits such that /3 
as n ^ oo and, so, we can assume f3{x'^) > /3 — e. 

We take A = A2 as defined before, and then lemma [3] shows that, for each n 
there is a periodic point G Sa(^) such that /3(z") > /3(x")| Therefore, as 
f3{x'^) P as n ^ 00, so does I3{z^), and we're done. □ 

Proof of the existence in Theorem 0. The theorem follows in the same way. In 
fact, in the proof of theorem [1] we only use the fact that / is coercive to guarantee 
the existence of Ii and I2 satisfying the hypothesis given, and to guarantee that 
(5 > 0. In this case, it's enough to consider d := min{Ci, C2}— sup /|[^^^^] > 0. □ 

4 Proof that supp v C Ea(^) for any v maximal 

Let's keep the same notation from the previous section, in particular recall that 
A = A2- The proof for theorems [1] and [2] are similar, so we make no distinction 
here. 

We know from the previous section that there is at least one maximal measure 
whose support is in Sa(^2)- Besides, from lemma [3l we also know that there is 
no periodic maximal measure whose support is not contained in Sa(^2)- 

Now consider 1/ a non periodic maximal measure for / and by contradiction 
suppose that supp 1^ <f. Sa(^2)- By the Ergodic Decomposition theorem we can 
suppose V is ergodic. 

The key step now is to build an invariant periodic measure using a generic 
point on supp whose ergodic average is strictly greater than /3, which is absurd 
and proves our result. It's convenient to consider /3 = hereH 

^Notice that z" here may be taken as 2:" if G Ea(.4). 
^This is easily done by considering f — 13. 
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Let X = {xoXiX2 . . . ) £ supp v he a, generic point such that /3m{x) ^ as 
m — )• DO and x is recurrent. Because of lemma [21 we can assume without loss of 
generality that xq < Ii. 

Since supp v (f. YjfiJyA'i)^ there is a symbol I > I2 appearing in the expression 
of X. 

We want to modify x into a new point z such that z is periodic and I3{z) > 0. 
Since this periodic orbit induces an invariant periodic measure ^ that has j f dfi = 
fi{z) > 0, this gives a contradiction with the fact that we took v a maximizing 
measure, and we're done. Notice that there's no need for z to be in Sa(^2) for 
this to work. 

Let i be the smallest integer such that Xi = I, and consider b < i the greatest 
integer such that Xb < h and a > i the smallest integer such that Xa < h- 

In this way, we find a word w beginning with x^ and ending in Xa such that 
between them there are only symbols greater or equal to Ji and at least one symbol 
equal to / > /2- We aim at exchanging w for w, which is another word beginning 
in Xfe and ending in Xa but between them we put, if necessary, a connecting word 
y made of symbols in Sa(^i). That is, w = XbyXa (but maybe w = x^Xa )■ 

Let mi be the size of the prefix of x finishing precisely after the first appearance 
of w in the expression of x. Exchange w for w, and using the same calculation^ 
in the proof of lemma [31 we get with a modified new prefix of size rhi such that 



We can repeat this process with the next appearances of w in the expression 
of X, and after k exchanges, we get a new point x^ such that 



Then, let be an integer such that (A^ — 1)5 > Po\ min/|x;^(_4^)| +2V{f). There- 
fore, we have 



m < ^ as the greatest integer such that Xm < Ii- It's clear that m > mi^. Also, 
since Xm+i, ■ ■ ■ ,Xi are greater or equal to /i, from the choice of Ii on lemma [21 
we have that Smf{x) > Sif{x) and so we get 



Notice that Smf{x) = Sm^fix) + S'm-m,jv/(c™'^ (x)). Let m is the position of 
XfYi 111 oc ^ after the A^ exchanges we made, and since by the definition of x^ we 
have (t'"^(x) = a^^{x^), we also have that fh — friN = m — mjv. Therefore 



SmJ{x) + 6<S^J{x^). 



S^J{x) + k5<Sf^Jix'). 




Smfix) > . 



(6) 



Smf{x ) 



Smi^f{x ) + Si 



fia^Hx)) 




^Notice that, in fact, the calculations are a little bit easier here since we're only looking for 
the ergodic sums and not the averages. See remark 1. 



12 



RODRIGO BiSSACOT AND RiCARDO DOS SANTOS FREIRE Jr 



Now, let u be a word in Sa(-4.i) of size q connecting Xm{=Xm) to xq, and let z G 
Sa(N) be the periodic point given by the repetition of the word Xq . . . x~^_^u, 
that is, the prefix of size in of concatenated with u. Let p = in + q he the 
period of z. 

Similarly to the proof of lemma [3l we have that 

Spfiz) = S^f{z) + SJ{a'^{z)) 

> Sf^f{x'')-V{f) + SJ{a^{z)) 

> 5^/(x^)-2y(/)-Po|min/s^(^,)|, 

and by ^ we get 

Spf{z)>S^^f{x) + 6, 

so that by ^ we have 

Spfiz) >^-, 

and we're finally done, since 

I3{z) = -Spf{z)>^>0. 



5 The case of E(R+) 

In the case of the full shift a on S(M'^) := M"^^, the sequences of positive reals, 
where the shift is the same as before, and all sequences are allowable, the previous 
technique works. In fact the proof of the theorem is easier, since the proof of 
lemma [3] is restricted to the case when we don't need any further symbols to 
create the orbit z. 

In particular, we only need to consider the second constant in ([2]). 

Finally, we notice that in this case we cannot assure that / is bounded above 
from the fact that it's coercive and has bounded variation, so we have to make 
this hypothesis to guarantee the existence of /3 here. 

In this way, we get the following theorem, that is an analogous to corollary 6.2 
in [7]: 

Theorem 3. Let a be the full shift on and f : R be a bounded 

above function with bounded variation and assume there are real numbers I2 > 
Ii > such that 

sup/|[j] < /3-e y j >Ii, 

for some e > fixed and 

sup/|[j] < min/|s([o,7i]) - V{f) M 3 > h ■ 
Then, we have that 

P = sup f dfi . 

li£MaiT,i[0,l2])) J 
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Furthermore, if v is a maximizing measure, then 

SUppuCMam[0,l2])). 

In the case that / is coercive, we have the following: 

Corollary 1. Let a be the full shift on S(M+) and f : S(M"'") — >■ M &e a bounded 
above function with bounded variation and coercive. Then, there is I > such 
that 

/3 = sup f dfi . 

neMamo,!])) J 

Furthermore, if v is a maximizing measure, then 

supp V C M<,(S([0,I])) . 
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